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A  NESTED- DECOMPOSITION  APPROACH  FOR 


SOLVING  STAIRCASE-STRUCTURED  LINEAR  PROGRAMS 


by 

Philip  G.  Abrahamson 


Abstract 


The  algorithm  solves  a  T-period  staircase-structured  linear  program 
by  applying  a  compact  basis-inverse  scheme  for  the  Simplex  Method  in  con¬ 
junction  with  a  choice  mechanism  which  uses  the  dual  of  the  Nested  Decom¬ 


position  Principle  of  Manne  and  Ho  to  determine  the  incoming  basic  column. 
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A  sequence  of  one-period  problems  is  solved  in  which,  typically,  information 
is  provided  to  period  t  from  previous  and  subsequent  periods  in  the  form 
of  surrogate  columns  and  modified  right-hand  side,  and  surrogate  rows  and 
modified  cost  coefficients,  respectively. 
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I.  Introduction 


This  paper  describes  preliminary  work  on  an  algorithm  for  solving 
staircase-structured  linear  programs.  Such  problems  often  arise  in  the 
modeling  of  phenomena  which  are  naturally  described  as  evolving  over  a 
sequence  of  temporal  or  spatial  "periods".  A  pure  nested  decomposition 
algorithm  transforms  the  problem  into  an  ordered  set  of  smaller  problems, 
one  for  each  period,  which  are  coordinated  only  through  price  and  acti¬ 
vity  communication  between  adjacent  periods.  The  process  o£  achieving  an 
optimal  coordination  involves  repeated  solution  of  the  individual  prob¬ 
lems.  Preliminary  experience  has  indicated  that  the  convergence  of  the 
pure  algorithm  may  be  slow.  To  accelerate  this  convergence,  the  algorithm 
is  modified  to  enable  the  individual  problems  to  communicate  in  an  impli¬ 
cit  fashion  whenever  possible.  This  modification  involves  the  genera¬ 
tion  of  surrogate  columns  which  are  passed  to  subsequent  periods,  allow¬ 
ing  these  period  to  parametrically  adjust  solutions  to  earlier  periods. 

A  compact  basis-inverse  scheme  is  used  to  represent  these  parametric 
variations . 

Section  2  states  the  problem  of  interest  and  describes  the  pure  nested 
decomposition  algorithm.  Section  3  outlines  the  modified  approach  and 
discusses  some  details  of  implementation. 
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2.  Nested  Decomposition  of  the  Staircase  Structure 
2 . 1  Mie  Staircase  Structure 
The  problem  of  Interest  is 


minimize 


subject  to 


E  ctxt 
t  =  l 


A1X1 


^t-iVi  +  Atxt 


x  2  0 


t  *  2, 
t  -  1, 


T 

T 


where  is  x  1  ,  At  is  x  n^  ,  and  all  other  vectors  and 
matrices  are  of  conformable  dimension.  This  linear  program  is  said  to 
be  staircase-structured  because  the  constraint  matrix  has  the  form: 


Figure  1:  Staircase-Structured  Constraint  Matrix 


The  inven- 


Activities  in  period  t  are  represented  by  the  matrix  At  . 
tory  provided  by  period  t  to  period  t  +  1  is  described  by  the  matrix 
-Bt  •  Otherwise,  the  activities  in  period  t  have  no  direct  effect  on 
either  previous  or  subsequent  periods. 

The  dual  of  (P)  is 

T 

(D)  maximize  £  ^  b 

t=l  Z  * 

subject  to  "tAt  -  1  ct  ’  t  -  1,  . . . ,  T  -  1 

*T*T  1  CT  ' 


2.2  Nested  Decomposition 

Manne  and  Ho  [7]  and  Glassey  [5]  repeatedly  applied  the  decomposition 
principle  of  linear  programming  developed  by  Dantzig  and  Wolfe  [3]  to 
achieve  a  nested  decomposition  of  (P)  .  A  sequence  of  applications, 
modif ications,  and  improvements  has  led  to  advanced  implementations  by 
Ho  and  Loute  [6],  who  have  solved  some  large-scale  problems  more  rapidly 
in  this  fashion  than  by  directly  applying  commercial  linear  programming 
to  (P)  . 

Van  Slyke  and  Wets  [8]  describe  an  algorithm  for  solving  (P)  in  the 
case  T  =  2  which  is  equivalent  to  applying  the  decomposition  algorithm 
to  (D)  .  Dantzig  [2]  outlined  an  algorithm  consisting  of  a  nested  de¬ 
composition  of  (D)  .  This  paper  represents  preliminary  work  on  the  de¬ 
velopment  of  a  technique  which  is  based  on  his  approach. 
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2 . 3  A  Nested  Decomposition  Algorithm  for  (D) 

The  algorithm  of  Dantzig  [2]  consists  of  the  following  nested  decom¬ 
position: 


TT  h  -+*  7Trtb~ 

TT  „b  ~  +  TT,b,  +•  •  • 

’  *  +  Ti  b 

11  2  2 

33  4  4 

T  T 

^1^1  ~  ^2^1 

< 

^2^2  _ 

tt0B  _ 

<_ 

3  2 

7T„  A~  “  TT.  B  ^ 

< 

3  3  4  3 

— 

r-i\-] 


master. 


master. 


*  sub^ 


"t8!-!  -  CT— 1 I 


7ITAT  -  CT  J 

Figure  2:  Nested  Decomposition  of  (D) 


)  master 
}  SubT-l 


Let  x  „  be  multipliers  for  master  -  ,  and  let 
t-1  p  t-1 


bt  =  bt  +  Bt-ixt-i 


Then  the  t-th  period  master  problem  has  the  form 


<V 

maximize 

+  °tft  + 

subject  to 

*tAt  +  °tFt  +  ptLt  -  ct 

:  x 

pte  <  1 

:  0 

where  (Ft>  f  )  and  ( L l^)  are,  respectively,  the  extreme  ray  and 
extreme  point  proposals  generated  by  period  t  +  1  .  For  t  =  1  ,  b^  =  b^  , 
and  for  t  =  T  ,  only  the  terms  involving  n  are  present.  Note  that 
each  proposal  is  a  row  vector. 

The  dual  of  (D^)  is 


(pt) 


minimize 


z  =  c  x  +  0 

t  t  t  t 


subject  to 


Vt 


-  bt  + 


Vt 


>  f 


:  a 


Ltxt  +  eGt  h 


: 


x  >  0  . 

t  - 

In  these  problems,  b^  represents  the  original  term  from  (P)  as 

modified  by  the  inventory  supplied  by  the  current  period  t  -  1 

solution  x^  -  .  The  dependence  of  b  on  ,  will  usually  be  sup- 

t-1  r  t  t-1 

pressed  for  clarity.  The  constraints  F  x  >  f  and  Lx  +  eB  >  £ 

J  t  t  —  t  ttt-t 

are  necessary  conditions  for  a  solution  x  to  not  lead  to  future  in¬ 
feasibilities  or  non-optimal  solutions.  Accordingly,  they  are  called 

feasibility  and  look-ahead  (optimality)  cuts,  respectively.  The  constraints 
A^x^  =  b  +  i  are  called  the  body  of  the  constraints. 

The  full  master  problem  (D^)  ,  which  includes  all  possible  proposals 
from  the  future,  is  equivalent  to  (P)  .  Computationally,  a  restricted 
master  is  maintained  at  each  period  by  including  proposals  as  they  are 
generated  and  occasionally  purging  old  proposals  which  are  no  longer  basic  in 
(D  )  .  It  will  be  clear  from  context  which  sets  of  proposals  are  indi¬ 
cated  by  ( F^ ,  f^ )  and  (Lt,  f  )  . 
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While  nested  decomposition  of  (D)  produces  the  problems  (D  )  ,  it  is 
usually  more  instructive  and  more  convenient  computationally  to  work  with 
their  respective  duals  ( P ^ )  .  In  general,  the  problem  at  period  t  acts 
as  a  subproblem  with  respect  to  periods  1,  ....  t  -  I  ,  and  as  a  restricted 
master  problem  with  respect  to  periods  t  +1,  .  ..,  T  .  The  communication 
between  the  problems  (P  )  can  be  represented  schematically: 


master 


i 


i 

sub  \ 


i 

i 

i 

i 


I 

i  master 


1 


i 

i 

i 

i 


Note  that  the  form  of  the  Look-ahead  cuts  is  such  that  they  essentially 
mod  i  f v  the  objective  function  in  each  (P  )  . 

The  act  of  solving  one  of  the  restricted  master  problems  (P  )  is 
called  a  step.  If,  at  some  step,  (P  )  is  infeasible,  a  feasibility 
cut  is  generated  and  imposed  on  (P  .  If  a  step  terminates  with  a 

finite  optimal  solution  to  (P  )  ,  a  modified  right-hand  side  for  (P 
is  generated.  If  in  the  latter  case  it  is  also  found  that 


6 


*  0 
where  z^_  is  the  new  optimal  objective  for  (P^)  and  0^  corresponds 

to  the  most  recent  solution  to  (P  ,  a  look-ahead  cut  is  generated 

which  may  be  imposed  on  (Pfc  *  If  (?t)  is  found  to  have  a  class 
of  solutions  with  objective  unbounded  below,  a  solution  x^  and  a  homo¬ 
geneous  solution  h^  are  generated  in  the  usual  fashion.  The  desired 
effect  of  providing  (P  with  a  right-hand  side  of  the  form 


bt+l  +  Vc  +  aBtht 


a  >  0 


(3) 


is  achieved  by  introducing  into  (P  a  surr°gate  activity,  with  level 

a  _>  0  ,  represented  by  the  column 


-Vt 


(4) 


with  cost  coefficient  c  •  If  (P)  has  a  class  of  solutions  with  ob¬ 
jective  unbounded  below,  eventually  a  ray  indicating  this  will  be  gener¬ 
ated  in  (P^,)  .  Otherwise,  a  look-ahead  cut  will  be  generated  in  ( P ^ , )  , 
for  some  t!  >  t  ,  which  ’’cuts  off"  the  ray  successively  in  (P^,  ^ ) , 

....  (pp  . 


A  wide  variety  of  computational  strategies  may  be  employed  within  the 
framework  described  above.  There  is  freedom  both  in  the  order  in  which 
the  problems  (P  )  are  solved  and  in  when  to  pass  information  between 
problems  in  the  form  of  cuts  and  modified  right-hand  sides.  Computational 
experience  has  indicated  that  the  rate  of  convergence  of  the  algorithm 
can  vary  significantly  when  different  strategies  are  employed.  This  ex¬ 
perience  has  also  indicated  that  in  order  to  attain  the  ease  of  solution 
initially  envisioned  for  this  approach,  signficant  modifications  to  the 
algorithm  described  are  necessary. 
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3 .  A  Modified  Nested  Decomposition  Approach 


3. 1  Passing  Surrogate  Columns  Forward 

Suppose,  at  some  step  in  the  course  of  executing  the  algorithm  des¬ 
cribed  in  Section  2.3,  a  finite  optimal  solution  to  (P^)  is  obtained. 

The  optimal  basis  must  include  0^  and,  assuming  A^_  is  of  full  rank, 
at  least  of  the  variables  x^_  .  Some  slack  variables  corresponding 

to  cuts  which  have  been  imposed  may  also  be  basic.  Let  k^  0  and 
k^  _>  1  be  the  number  of  feasibility  and  look-ahead  cuts,  respectively, 
whose  slack  variables  are  not  basic.  Then  +  k^  +  k7  -  1  of  the 
variables  are  in  the  optimal  basis.  Ordinarily,  the  optimal  solution 

is  used  to  form  a  right-hand  side 


bt+i + 


B  *° 

t  t 


(5) 


for  the  body  of  the  constraints  in  (P  )  . 

t+1 

A  modification  to  this  technique  is  outlined  as  follows.  Let 


k  kl  +  k2  “  1  (6) 

be  the  number  of  ’’surplus"  variables,  and  let  0^  be  the  optimal  basis, 
excluding  slacks  from  cuts.  Partition 


6t  =  LBt  U  NBt  U  {  V 


(7) 


where  LB 


>  Inb^)  =  k  *  and  A^  exists,  where  A^  is  a  con¬ 
venient  abuse  of  the  proper  notation  (A^)  ^  ^  ^  •  The  variables 

are  called  the  local  basis.  Solve  the  body  of  the  constraints  in  (P  ) 


versus  the  right-hand  side  b ^  to  yield  the  locally  basic  solution 
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(8) 


<V°  =  A^tb_t 


Represent  the  remaining  basic  variables  in  terms  of  the  local  basis. 


YNBt  =  ALBtANBt 


(9) 


so  that 


(  "LB.  \  /(XLB.,0\  / 


Xt  ’  *NB 


\*  /  V  .  /  \ 


NB 

I 

0 


0 

*NB 


(10) 


Let 


Ht  * 


NB 

I 

0 


(ID 


be  the  set  of  homogeneous  solutions  to  the  body  of  the  constraints  which 


NB. 


are  generated  by  the  representations  Y 

locally  basic  solution  (x  )^  to  form  a  right-hand  side 

LBt 


In  contrast  to  (5),  use  the 


Vl  +  Bt(xLBt) 


(12) 


for  (P  .  In  addition,  introduce  into  (Pt+^)  a  set  of  k  surro¬ 
gate  activities,  with  levels  2  0  >  represented  by  columns  with 


st+i  =  -BtHt 


(13) 


in  the  body  of  the  constraints,  zero  coefficients  in  the  cuts  on  (P  , 


and  cost  coefficients  5:1  ctH  •  modified  problem  is 
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<pt+l> 


minimize  z 


t+1 


subject  to 


st+iVi  +  ct+ixt+i  +  0t+i 

st+l“t+l  +  At+lxt+l 

= 

\+l 

'  1+1 

Ft+lxt+l 

> 

ft+l 

:°t+l 

L  x  ,  +  0 

> 

l 

:  c 

t+1  t+1  t+1 

t+1 

pt+l 

°t+l*  Xt+1  ±  °  * 

This  structure,  in  essence,  endows  (P  with  a  right-hand  side 
which  is  parametrized  in  terms  of  the  k  variables  ,  and  allows 

(Pt+j)  to  select  the  coefficients  t^ie  Paramet:rization •  Set¬ 
ting  corresponds  to  the  right-hand  side  (5)  obtained  in 

the  pure  nested  decomposition  framework.  Passing  activities  down  the 
staircase  and  allowing  a  ^  vary  from  these  values  provides  an 
avenue  of  implicit  communication  between  (P  .p  anc*  (Pt)  »  .  (P^) 

which  decreases  the  number  of  steps  needed  to  obtain  an  optimal  coordi¬ 
nation  of  the  single-period  problems. 

There  are  two  potential  disadvantages  inherent  in  this  approach. 
First,  it  seems  that  forcing  (P  to  have  some  or  all  of  the  variables 

at+l  *ts  ^as^s  would  unacceptably  limit  the  number  of  basic  variables 

chosen  from  •  Second,  the  framework  sketched  above  allows  (P 

to  use  the  surrogate  activities  at  any  nonnegative  levels.  In  order  to 
satisfy  the  body  of  the  constraints  in  (P  )  ,  the  relationship 


)  -  Ov»  )<* 


LB 


NB 


t+1 


(14) 


must  be  maintained.  Since  (P  )  may  include  surrogate  activities  inherited 
from  (P  ,  in  general  a  parametriza tion  of  all  variables  which  are  locally 
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basic  in  (Pt),  •••»  is  obtained  in  terms  of  the  surrogate  activities 

received  by  (Pt+^)  .  Clearly,  nonnegative  levels  of  could  cause 

the  parametrized  values  of  variables  in  earlier  periods  to  have  negative 

components.  These  two  points  are  addressed  in  the  next  sections. 

3 . 2  Degeneracy  in  Optimal  Solutions  Generated 
by  Nested  Decomposition  of  (D) 

It  is  well-known  that  bases  for  (P)  inherit  the  staircase  structure 

of  the  general  problem  and  exhibit  a  ’‘surplus-shortage1'  property  which 

generalizes  the  fact  that  a  basis  which  contains  +  k  of  the  variables 

,  with  k  >  0  ,  must  exhibit  a  ‘‘shortage"  of  k  ,  relative  to  the  num- 

T 

ber  of  remaining  constraints,  L  m  ,  in  the  number  of  basic  variables 

t=2  t 

selected  from  x^,  .  ..,  .  Fourer  [4]  has  developed  a  set  of  bounds 

on  the  magnitudes  of  the  surpluses  and  shortages  which  each  period  of  a 
basis  may  possess. 

The  following  result  describes  a  manifestation  of  this  property  in  the 
setting  of  the  algorithm  developed  in  Section  2.3. 

Theorem.  Suppose  an  optimal  coordination  of  the  single-period  problems 
(P  )  has  been  obtained.  If  t  <  T  and  (P^)  has  k  +  1  cuts  whose 
slack  variables  are  nonbasic,  then  the  basic  solution  to  (P^+^)  has  at 
least  k  degenerate  variables. 

Under  the  modification  outlined  in  Section  3.1,  surrogate  columns 

passed  from  period  t  replace  degenerate  variables  in  the  optimal  basis 
in  period  t  +  1  .  These  degenerate  variables  may  include  basic  slack 
variables  for  the  cuts  in  period  t  +  1  .  The  fact  that  the  surrogate 
columns  replace  degenerate  variables  guarantees  that  no  solutions  of 
interest  are  excluded  in  (P^^)  . 
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3 . 3  Maintaining  Feasibility  of  Loca lly 
Basic  Solutions 

As  indicated  at  the  end  of  Section  3.1,  nonnegativity  of  does 

not  imply  nonnegativity  of  the  parametrized  values  of  the  variables  which 
are  locally  basic  in  periods  1,  .  ..,  t  .  Two  general  approaches  to  sur¬ 
mounting  this  difficulty  are  possible.  First,  the  feasibility  of  earlier 
periods  can  be  ignored  during  the  optimization  of  the  modified  problem 
(P  +^)  and  restored  in  a  subsequent  procedure  which  would  minimize  an 
appropriate  infeasibility  form.  The  alternative  is  to  employ,  while  op¬ 
timizing  (P  ,  an  extended  minimum-ratio  test  which  follows  the  para¬ 

metric  variation  of  locally  basic  variables  in  earlier  periods  and  indi¬ 
cates  when  such  a  variable  blocks  the  increase  of  an  incoming  column  in 

The  latter  approach  is  adopted  here.  The  representation  of  an  incoming 
column  in  (P  includes  weights  on  any  surrogate  columns  which  are  in 

the  local  basis.  Using  these  weights  and  repeatedly  applying  (14)  and  (9) 
yields  a  representation  of  the  incoming  column  in  terras  of  the  variables 
which  are  locally  basic  in  periods  1,  .  ..,  t  +  1  .  This  representation 
is  used  to  implement  the  extended  minimum-ratio  test.  This  scheme  of 
local  inverses  linked  by  representations  of  surrogate  columns  can  be 
viewed  as  a  compact  basis-inverse  technique  which  maintains  a  nearly 
block-angular  inverse  of  the  columns  which  are  locally  basic  in  periods 
1,  ...,  t  +  1  . 

When  the  extended  minimum-ratio  test  reveals  that  a  variable  in  a 
period  prior  to  t  +  1  blocks  the  increase  of  an  incoming  column  in 
( P t+i )  severa^  strategies  may  be  employed.  The  choice  in  this  work  is 
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to  "shuffle"  the  structure  of  the  surrogate  columns  by  exchanging  the 
roles  of  some  of  the  activities  which  are  and  are  not  locally  basic. 

This  process  is  designed  to  take  the  blocking  variable  and  pass  it  down 
to  (Pi)  as  a  surrogate  column.  Primal  and  dual  solutions  in  each 
period  are  unchanged,  and  when  optimization  of  (P  *s  resumed,  the 

same  incoming  variable  is  blocked  by  this  surrogate  column.  The  indi¬ 
cated  pivot  in  (P  is  made  and  maintains  the  nonnegativity  of  locally 

basic  solutions  in  periods  prior  to  t  +  1  . 

3 . 4  Computational  Strategies  and  Further  Work 

Again,  a  wide  variety  of  computational  strategies  may  be  employed 
within  the  framework  described  above.  There  is  freedom  in  the  order 
in  which  the  problem  (P^_)  are  solved  and  in  when  to  pass  information 
between  problems  in  the  form  of  cuts,  modified  right-hand  sides,  and 
surrogate  columns.  The  presence  of  the  surrogate  columns  opens  addi¬ 
tional  options,  including  variations  of  the  "shuffle"  described  in  Sec¬ 
tion  3.3. 

Currently,  computational  experience  is  being  obtained  with  a  code 
written  by  Wittrock  in  Mathematical  Programming  Language  at  Stanford 
University.  This  language  facilitates  experimentation  of  the  type  needed 
at  this  stage  of  the  work.  The  thrust  of  this  experimentation  is  to  de¬ 
vise  computational  strategies  which  tend  to  minimize  the  computational 
effort  needed  to  obtain  an  optimal  solution  to  (P)  .  Since  the  manipu¬ 
lations  of  data  structures,  and  the  form  and  frequency  of  updates  to  the 
local  inverses,  depend  heavily  upon  the  computational  strategies  which 
are  employed,  decisions  about  these  factors  have  not  yet  been  made. 
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